On True Score Evaluation Using Item Response Theory Modeling
نویسندگان
چکیده
منابع مشابه
Diagnosing item score patterns on a test using item response theory-based person-fit statistics.
Person-fit statistics have been proposed to investigate the fit of an item score pattern to an item response theory (IRT) model. The author investigated how these statistics can be used to detect different types of misfit. Intelligence test data were analyzed using person-fit statistics in the context of the G. Rasch (1960) model and R. J. Mokken's (1971, 1997) IRT models. The effect of the cho...
متن کاملAn Evaluation of Mathematics Competitions Using Item Response Theory
D uring the past century, mathematics competitions have become part of the landscape in mathematics education. The first major mathematics competition in the United States began with an idea of William Lowell Putnam in 1921 [6], and the mathematics competition named in his honor has become the premier mathematics competition in the United States for undergraduates, with 508 schools and 3,640 in...
متن کاملBuilding an Evaluation Scale using Item Response Theory
Evaluation of NLP methods requires testing against a previously vetted gold-standard test set and reporting standard metrics (accuracy/precision/recall/F1). The current assumption is that all items in a given test set are equal with regards to difficulty and discriminating power. We propose Item Response Theory (IRT) from psychometrics as an alternative means for gold-standard test-set generati...
متن کاملBeyond Majority Voting: Generating Evaluation Scales using Item Response Theory
We introduce Item Response Theory (IRT) from psychometrics as an alternative to majority voting to create an IRT gold standard (GSIRT ). IRT describes characteristics of individual items in GSIRT their difficulty and discriminating power and is able to account for these characteristics in its estimation of human intelligence or ability for an NLP task. In this paper, we evaluated IRT’s model-fi...
متن کاملSelection the best Method of Equating Using Anchor-Test Design in Item Response Theory
Explaining the problem. The equating process is used to compare the scores of the two different tests with the same theme. The goal of this research is finding the best method of equating data using Logistic model. Method. we are using the data of Ph.D. test in Statistic major for two consecutive years 92 and 93. For analyzing, we are specifically using the tests of Statistics major ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Educational and Psychological Measurement
سال: 2017
ISSN: 0013-1644,1552-3888
DOI: 10.1177/0013164417741711